dl project
Beyond Accuracy: An Empirical Study on Unit Testing in Open-source Deep Learning Projects
Wang, Han, Yu, Sijia, Chen, Chunyang, Turhan, Burak, Zhu, Xiaodong
Deep Learning (DL) models have rapidly advanced, focusing on achieving high performance through testing model accuracy and robustness. However, it is unclear whether DL projects, as software systems, are tested thoroughly or functionally correct when there is a need to treat and test them like other software systems. Therefore, we empirically study the unit tests in open-source DL projects, analyzing 9,129 projects from GitHub. We find that: 1) unit tested DL projects have positive correlation with the open-source project metrics and have a higher acceptance rate of pull requests, 2) 68% of the sampled DL projects are not unit tested at all, 3) the layer and utilities (utils) of DL models have the most unit tests. Based on these findings and previous research outcomes, we built a mapping taxonomy between unit tests and faults in DL projects. We discuss the implications of our findings for developers and researchers and highlight the need for unit testing in open-source DL projects to ensure their reliability and stability. The study contributes to this community by raising awareness of the importance of unit testing in DL projects and encouraging further research in this area.
- Oceania > Australia (0.04)
- Asia > China > Jilin Province > Changchun (0.04)
- Europe > Finland > Northern Ostrobothnia > Oulu (0.04)
- (3 more...)
- Information Technology > Software (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Software engineering for deep learning applications: usage of SWEng and MLops tools in GitHub repositories
Panourgia, Evangelia, Plessas, Theodoros, Spinellis, Diomidis
The rising popularity of deep learning (DL) methods and techniques has invigorated interest in the topic of SE4DL, the application of software engineering (SE) practices on deep learning software. Despite the novel engineering challenges brought on by the data-driven and non-deterministic paradigm of DL software, little work has been invested into developing AI-targeted SE tools. On the other hand, tools tackling more general engineering issues in DL are actively used and referred to under the umbrella term of ``MLOps tools''. Furthermore, the available literature supports the utility of conventional SE tooling in DL software development. Building upon previous MSR research on tool usage in open-source software works, we identify conventional and MLOps tools adopted in popular applied DL projects that use Python as the main programming language. About 70% of the GitHub repositories mined contained at least one conventional SE tool. Software configuration management tools are the most adopted, while the opposite applies to maintenance tools. Substantially fewer MLOps tools were in use, with only 9 tools out of a sample of 80 used in at least one repository. The majority of them were open-source rather than proprietary. One of these tools, TensorBoard, was found to be adopted in about half of the repositories in our study. Consequently, the use of conventional SE tooling demonstrates its relevance to DL software. Further research is recommended on the adoption of MLOps tooling by open-source projects, focusing on the relevance of particular tool types, the development of required tools, as well as ways to promote the use of already available tools.
- Europe > Netherlands > South Holland > Delft (0.04)
- Europe > Greece > Attica > Athens (0.04)
- North America > United States > Washington > King County > Bellevue (0.04)
- (5 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (0.93)
- Information Technology > Services (0.67)
- Information Technology > Software (0.49)
How to Manage AI, ML or DL Projects?
Managing a project properly is one of the factors behind its completion and subsequent success. The same can be said for any artificial intelligence (AI)/machine learning (ML)/deep learning (DL) project. Moreover, efficient management in this segment holds even more prominence as it requires continuous testing before delivering the final product. An efficient project manager will ensure that there is ample time from the concept to the final product so that a client's requirements are met without any delays and issues. As already established, efficient project management is of great importance in AI/ML/DL projects.
Review of Deeplearning.ai Courses – Towards Data Science
I've found the review on the first three courses by Arvind N very useful in taking the decision to enroll in the first course, so I hope, maybe this can also be useful for someone else. Taking the five courses is very instructive. The content is well structured and good to follow for everyone with at least a bit of an understanding on matrix algebra. Some experience in writing Python code is a requirement. The programming assignments are well designed in general.
- Education > Educational Setting > Online (0.73)
- Education > Educational Technology > Educational Software > Computer Based Training (0.50)
What are the key differences between FPGA and GPUs for Deep Learning?
I'm trying to investigate the ways in which FPGAs differ to GPUs for the purpose of deep learning. I understand this is a complex question and not necessarily easy to answer in one go, however what I'm looking for are the key differences between the two technologies for this domain. Ideally, it would be nice to see the benefits and cons of both technologies with regards to Deep Learning. In addition, from my understanding, and please correct me if I'm wrong, is that with FPGAs, those undertaking a DL project would need someone who is able to configure the FPGA according to the type of project they want through the use of languages such as Verilog or VDHL. Furthermore, if they want to change the type of DL project they want to do, they have to reconfigure the FPGA to follow suit.